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FOREWORD 


This document partially comprises the final report prepared by Honeywell, Incoporated 
for George C. Marshall Space Flight Center, Huntsville, Alabama, 35S12 under Contract 
NAS 8-11206, 

NASA CR-547 contains the results of four studies related to the mlnimax control problem. 
Two short studies of the effect of non-zero initial conditions on performance and 
selection of minimax controllers from a given set of controllers were reported. The 
other two studies present means for determining extremal bounded amplitude, bounded 
rate inputs to linear systems. 

The work on this contract was supervised by Mr. C. R,. Stone and Dr. E. R. Rang. 

This document was prepared by Mr. K. D. Graham and Mr. D. D. Fairchild and 
Dr. C. A. Harvey contributed to the work. 
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ABSTRACT 


Optimal control theory has been applied to a piecewise constant approximation 
of a large launch booster for the first 84 seconds of flight. This period was 
divided into seven intervals with a different constant approximation of the 
vehicle in each interval. The controllers considered are linear controllers 
with constant gains in each flight interval. The disturbances are the cross- 
winds of bounded amplitude which cause the maximum of any of several cost 
items to occur in each flight interval, and each cost item is proportional to 
some physical quantity of interest. The cost of a given controller is the 
maximum of its several cost items. 

Optimal control theory provides a straightforward method of computing the 
cost of a finite set of controllers. The controller of the set with minimum cost 
is called the minimax controller of that set. It will usually be a sub-optimal 
controller since the cost computations (called minimax computations) are 
performed for only a finite set of controllers. 

Bending moment is weighted heavily in the cost items for the minimax com- 
putations. A comparison of control costs for specific drift-minimum con- 
trollers and minimax controllers is presented. It is found that the minimax 
controllers have lower gains and substantially lower costs than the specific 
drift minimum controllers considered. 

In the material presented, it is shown that one can impose "classical n design 
criteria on the class of controllers to be considered and still use minimax 
computations to specify remaining control parameters. 
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SECTION I 

QUALITATIVE PROBLEM DESCRIPTION 


The description of the launch booster studied is provided in a document from 
M.S. F. C. entitled. Model Vehicle No. 2 for Advanced Control Studies. In 
this report, the document is referred to as the data package. 

The large variations in speed, dynamic pressure, and vehicle characteristics 
during the first few minutes of powered flight show the importance of con- 
sidering a time-varying plant. 

Using minimax (optimal) control theory, the maximum values of items of 
importance (e.g. , pitch attitude, lateral velocity, gimbal angle, or bending 
moment) can be computed when the vehicle with a given controller is sub- 
jected to the bang-bang disturbance (e.g., cross-wind velocity) which switche 
sign at the time instants necessary to cause the largest possible response. 

Minimax theory in its present state may be applied efficiently to constant 
coefficient plants, and to time-varying plants by resorting to more expensive 
computations. The approach reported here has been to divide the first 84 
seconds of flight into seven intervals and to approximate the time-varying 
plant by a different set of constant- coefficient differential equations in each 
of the seven intervals. The fifth interval contains the event of Mach 1 and 
the seventh that of maximum dynamic pressure. 

One control criterion for large launch boosters is to minimize structural 
bending. A first approximation to this is to consider the vehicle as a rigid 
body and design a controller which minimizes the major causes of bending. 
This approximation' is used, and it has the advantage of having a simple 
formulation; yet it is likely to demonstrate the main features of designing. a 
controller for which minimization of maximum bending moments is weighted 
heavily as a design criterion. 


SECTION II 


SUMMARY OF THEORY AND EXTENSION 
OF COST FUNCTIONAL 


The following optimal control problem is considered. It is assumed that 
the plant is represented by the vector differential equation: 

x = Ax + Bu + Cg, x(0) = x° (1) 

In this equation, x is an n-vector describing the state of the system, x° is 
the given initial condition, u is an m -vector representing the control inputs, 
and g is a k-vector representing the disturbance inputs. A, B, and C are 
constant matrices of appropriate sizes. Classes of allowable controllers and 
disturbances are assumed to be as follows: 0 is a class of linear fixed-gain 
controllers, i.e., ue Q if: 


u = Qx + Rg 


( 2 ) 


where Q and R are constant matrices of appropriate sizes; the class of dis- 
turbances G is defined by: 


G 


= <g(t): a^ ^ g^(t) ^ U, a^ =s; U, i = 1, 2,.., k; t e |o, Tj, g(t) measurable 

l 1 1 1 ^ " J 


Associated with the class of disturbances G is a constant vector h (the mean 
disturbance of the class) defined by h. = (a^ 4- U)/2, i = 1, 2, . , , k. 

To define the performance index, it is assumed that weighting n-vectors d(i) 
and k-vectors f(i), i = 1, 2,.., , , s are given, where d(i) and f(i) are inde- 
pendent of t, x°, and g for each i. For ue Q, the cost functional C(u) is defined as 


C(u) = max U(u) 
l^Us 


(3) 


2 


(4) 


where the cost items C^(u) are: 

C^(u) = max max |d(i) • x(t;x°, u, g) + f(i) . g | 
[o, t] geG 


i - 2,411, s 

with x(t; x°, u, g) representing the solution to (1) with controller (2). An 
optimal controller is a u e Q which minimizes C(u). A minimax controller 
is one which minimizes C(u) over the set of u's considered. A minimax 
controller will in general be sub -optional since costs C will be determined 
over only a finite subset of all ue ft. 


Substitution of (2) in (1) gives the closed -loop equation 


X = A Q X + C R§ 

where Aq = A + BQ and C R = C + BR. Harvey has shown (Refer to 
Appendix A) that 

max max | d(i) - x (t; x, u, g)| 
te(o, T) geG 

= max {^(t) | + (t)^ 

te [o,t] 


(5) 


where 


A 't f At 

\^(t) = \^(t; x, u) = d(i) • e ^ x° + I d(i) • e ^ C R h 


( 6 ) 


b _ a /■ ^ 'I' 

H..(t) = ^(t; u) = y -1 — L J |d(i)*e ^C R (j) I dT 

j ^ o 

j = l 


(7) 
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It is seen from (6) that \(t) is independent of individual disturbances g(t), 
and depends on the mean h of all disturbances. From (7) one sees that the 
disturbances which maximize (5) have all bang-bang components. At 
the instant of time t (and corresponding g) for which (7) is maximum, one 
can change, if necessary, the signs of the components of g without changing 
the result of the maximizing process for Therefore, the values of (4) 
may be computed by: 

C^u) = max \.(t) | + ^(t)^ + max |f(i)* g | (4A) 

te [o,T] 

As also shown in Appendix A, everything necessary for the computation of 
\^{t) and jJL^(t) can be obtained by integrating n(k + 2) + 2s first order differ- 
ential equations, all but s of which are linear and the remaining s are piece 
wise linear. The required integration can be readily carried out on a high 
speed computer. 


The cost functional (3) is somewhat more general than the one of the same 
notation in Appendix A because the term f(i)* g in (4) jequivalently max 
| f(i)* g | in (4A)j is not considered in Appendix A. This extension of the 
cost functional was necessary to consider bending moment as a cost item 
in the formulation of the launch booster problem presented in this paper. 

The vectors d(i) and f(i) will be assumed to have the following form: 


d(i) = D i 


e.^i) 

f(i) = D. 

e n+l (i) 

• 


• 

• 


• 

e.(i) 



e (i) 
n 


_ e n+k (i) _ 


(8) 
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In each i, is constant. For each i and j, e^(i) may depend on controller 
gains, flight condition, etc. , but not on time. 


An important part of the subjective input to the minimax control design pro- 
cedure is in the choice of the weighting vectors d(i) and f(i). This choice 
is important since changing a particular weighting vector d(j) and/or f(j) 
in (4) will alter C^(u). This may alter the choice of the which is selected 
in (3) as the cost C, and thus alter the choice of the "best" controller (the 


one which minimizes C). 


The quantities selected for consideration in the control cost functional (3) 


will govern the selection of the e^.(i)*s. The relative weights to be given to 
each quantity selected are determined by the values chosen for the D^s. 

Cases will exist where certain ranges of values on some D^*s will be in- 
effective. A variety of illustrations appear in Section 5 for a three-dimensional 
state space (n = 3) to facilitate interpretation. 


5 


SECTION III 


EQUATIONS OF MOTION AND CONTROLLER FOR 
RIGID VEHICLE APPROXIMATION TO LAUNCH BOOSTER 


EQUATIONS OF MOTION 


A system of second order differential equations which represents the longitudinal 
motion of a rigid approximation to the launch booster described in the data package 
with open loop control is as follows: 


x - X 

I eg cp 

XX , & 


Z V IF 
w 


0 - v + V J " 2 I xx Kg " X ]3 13 


Z = M F ' X ‘‘a 


X Z V 


* ML v' V I + 2 M ^ 


This system has been linearized by assuming small angle of attack (5 degrees 
or less). Table 1 describes the symbols used. 

The controller class is that of linear fixed -gain controllers of the form: 

0 = K 1<S + K 2 i +feU - (-T-]v w • 


It is worth digressing momentarily to note that since attack angle ct is given by: 


<2 = 0 - 


Z - V 


(10) is equivalent to a controller using pitch attitude 0, pitch rate 0, and attack 
angle pt as shown in (10A). 
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Table 1. Table of Physical Quantities 


Symbol 


Description 


Drag Force 
Mass 

Dynamic Pressure 
Vehicle Velocity 
Mach Number 
Total Thrust 


Dimens ion 


kg-sec /m 
kg/m 2 
m /sec 


Moment of Inertia 


Engine Gimbal Point 
Diameter of Vehicle 


Normal Force Coefficient 


Drag Coefficient 


Center of Pressure 


Center of Gravity 


kg- sec - m 


x = (CP+Xo) Station of CP 
cp P 

x = (CG+Xq) Station of CG 


Station of Accelerometer m 

Normal Acceleration 

Pitch Attitude Deviation from rad 
Reference Trajectory 


Attack Angle 

Displacement Perpendicular 
to Reference Trajectory 

Bending Moment 

Bending Moment Coefficient 

Bending Moment Coefficient 

Speed of Wind Perpendicular 
to Reference Trajectory 


m- kg 
m- kg /rad 
m- kg /rad 


Gimbal Deflection Angle 


rad 






0 = (K x + K 3 ) 0 + K 2 0 - K 3 fl? (10A) 

Furthermore, by a more complicated manipulation, (10) can be shown to be 
equivalent to a linear controller with pitch attitude 0, pitch rate 0 , and normal 
acceleration A & feedback, where the normal accelerometer is located at x^. 

Note that it is also assumed that the gimbal motor perfectly reproduces the 
control signal. 


It is necessary to change (9) and (10) into the form and notation of Section II, 
The state vector x', controller u, and disturbance g (t, a.,b.) are defined as: 

0 


X = 


0 

z 


/ 


u = 0 


w 


a l = - 

IV 1 

1 w lmax 

b, = + 

IV 1 

1 

| w lmax 

a. = b. 

= 0, i / 

i i 

j* 

ii 

o 

all i 


Then define matrices A, B, and C: 

0 


A = 


(x c g - X Cp> 

>xx 


(F - X - a) w 


(X Cg ' V 


XX 


1 J_ 
M V 
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B 


where a = 



0 



0 

F 

(X Cg - x /3> 


C = 

= ( x Cg - Xcp) 

2 

!** 




F 

2 

1 

M 



1 1 
" a M V 

— 



-• 


— — 



It can be shown (most simply by direct verification) that equation (12) is 
equivalent to the open loop equations (9) written in the form of equation (1)1 


x = Ax + B|3 + CV 

w 


Direct comparison of (2) and 


Q 

R 



V 


K, 


(10) shows that 



V 


( 12 ) 


(13) 


pt is desirable to employ conventional notation before writing the closed loop 
orm of (12) and (13). Table 2 contains the details of the notation for A,B, and 

E . The resulting closed-loop equation x = AqX + C^V w where Aq = A+BQ and 
^ = C+BR is given as follows: 
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Table 2. Elements of Matrices A, B,'C in Terms 
of Vehicle and Trajectory Parameters 


a = 


a 


'D 


O 


X 


a i i = 0 


a 12 = 1 


a 13 = 0 


21 


a 1 x cg - x cp 


XX 


a 22 = 0 


a 23 ” a 21 


a 31 = (F - X - a) 


M 


a 3 2 0 


33 


a_ 

M 


h 1 = 0 


Cl = o 


F |x_ _ - Xgj 


eg 


2 I 


XX 


c 2 _a 23 a 21 


b„ = 


F 1 


3 2 M 


C 3 = " a 33 
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i 


0 

1 

0 


0 


0 

0 

= 

a 21 + b 2 

b 2 K 2 

* a 23 + b 2 K 3* (v) 


0 

+ 

* C 2~ b 2 K 3^ V 7 

z 


a 3 1 + b 3 K 1 

b 3 K 2 

< a 33 + b 3 K 3>lv) 


z 


( c 3~ h 3 K $^V 


( 14 ) 


Solutions x(t; x°,i8, V ) of (14) are those which appear in the cost functional 
(5). The definition of the disturbance class (just preceding 12) simply says 
that the cross-winds can blow equally hard in either direction. As a result, 
the vector h is identically zero so that the integral term in (6) makes no 
contribution to cost. 


The first term in (6) depends on initial conditions x° and is non-zero only 
when one or more state vector components are initially non- zero. All the 
computations reported in this document had zero initial conditions on each 
interval, so \^(t) = 0 for all i and all t. 


LUES OF COEFFICIENTS 


Inspection of Table 2 shows that the following coefficients and the values 
of velocity are sufficient to describe all time-variable elements of (14): 


a 2l' a 31' a 33’ b 2' b 3 


a 2i a 23 

The most striking variation with time is observed by plotting ~y~ = — y — — * 
This is shown in the top half of Figure 1 as a broken-line graph connecting 
the points eight seconds apart for which all information was available from 
the data package. The horizontal line segments show the seven intervals 
into which the first 84 seconds of flight were subdivided, and the corres- 
ponding values of ^ 1 over the interval spanned by each segment. The 
intervals and values were chosen by inspection of the graph. 
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The values of (Figure 2, top) were chosen in the same manner over the same 
subintervals. Then the values of V (Figure 4, bottom) were chosen to make the 

a JLL and a„. consistent in each subinterval. The values of 


selected values of 

the remaining coefficients and dynamic pressure q were selected by graphical 
inspection and the results are shown in Figures 1 through 4. One value was 
used in two or more of the later intervals for a^, a 33 J ^2’ anc * ^ 3 ' since 
these graphs did not have such wide variation as 
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The values of wind velocity magnitudes are shown in Table 3. The values are 
calculated from information in the data package. 


Table 3. Wind Velocity Magnitudes 


Interval 

- - - 

Time (sec) 

r w (ml sec) 

1 'max 

r i 

0-20 

13. 5 

l 2 

20-36 

19. 5 

h 

36-52 

31 

h 

52-60 

44. 5 

h 

60-68 

59 

h 

68-76 

75 

l l 

76-84 

75 
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SECTION IV 
BENDING MOMENT 


The formulation of bending moment, its value as a control criterion, and 
estimates of peak bending moment coefficients are given in this section. 


BENDING MOMENT FORMULATION 

One control criterion for large launch boosters is to minimize structural 
bending. The bending moments are caused by: 

• Engine gimbal deflection 

• Non- zero angle of attack 

• Influence of bending itself on local angle of attack 

• Fuel slosh 

The first two items are the major causes of bending moments. The third is 
relatively small and is absent until some bending has been caused by another 
source. Bending moments due to fuel slosh are small. Hence, bending 
moments depend primarily on engine gimbal deflection and attack angle, and 
will be assumed to have the following representation: 

M B = (M * a )a + (M^)j3 

The values of the coefficients M^ and M^ depend on the longitudinal location 
on the vehicle and other factors which vary with time (the most important ones 
will be stated later in this section under headings: M^ at CG versus Tim£ and 
M^ at CG versus Time) . Figure 5 shows M^ and M^ at t = 72 and t = 78 for 


(15) 
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the data package vehicle. Positions along the vehicle are measured by stations, 
each one meter long, numbered consecutively from zero at the engine gimbal 
to about 150 at the nose. Note that both and have peak values approxi- 
mately at station 35 (near the center of gravity) and taper more or less smoothly 
to zero at each end of the vehicle. 


BENDING MOMENT -- A CONTROL CRITERION 

Since the basic idea of minimax control of large launch boosters is to protect 
the structure, it would be preferable to minimize the ratio of bending moment 
to structural stiffness; i„ e. , minimize M^/(EI). The El distribution for Model 
Vehicle No. 2 has sharp relative minima of El (i. e. , weak spots) in zones about 
four meters long centered at about stations 23 and 50. The values of the ratios 
M^/(EI) and M^/(EI) near these two stations exceed their corresponding values 
at station 35, where and M^ themselves are maximum, by a factor of only 
about 1. 6. Thus, minimizing only bending moment Mg at any particular 
station or minimizing peak bending moment achieves about the same result as 
minimizing g^^fons [M^/(EI)] . The gain from either approximation is a 
simple control criterion. 


ESTIMATES OF BENDING MOMENT VERSUS TIME 

Estimates of Mg were needed for the whole interval 0 £ t ^ 84. During this 
interval, the CG of Model Vehicle No. 2 moved from station 37. 5 to 42, the 
peak value of M^ moved from station 33 to 30, and the peak value of M^ re- 
mained between stations 34 and 40 except for a short time in the third flight 

interval when the peak of M' occurred near station 56. It was assumed that 

a 

for 0 £ t £ 84, the peak values of M^ and M^ occurred at the same station 
(later specified as the CG) and the control criterion chosen was that of 
minimizing this peak value of Mg . 
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at CG versus Time 
a 


Figure 5 shows that the values of (72) exceed those of (78) by a sig- 
nificant amount. An elementary analysis indicates that ought to be 
somewhat proportional to dynamic pressure q. Since dynamic pressure 
has its peak value at t = 78, rather than at t = 72, it is seen that elementary 
theory is not suitable for approximation beyond t = 72. 

It was assumed that at the CG was proportional to q and inversely pro- 
portional to I in the interval 0 ^ t ^ 72, with values normalized to 
xx „ 

mM _72 3 1. 70 x 10 m-kg/rad. In the interval 72 £ t ^ 78, at the CG 
was obtained by linear interpolation between the peak values of shown in 
Figure 5. For 78 £ t £ 84, . The resulting graph is shown in 

Figure 6, together with the constant approximating values used in the seven 
flight intervals. 


at CG versus Time 


It was assumed that at the CG was proportional to thrust magnitude F 
and inversely proportional to longitudinal moment of inertia I , with values 
normalized to M^l = 4. 32 x 10 m-kg/rad. Figure 7 shows the resulting 
graph of at the CG versus time, together with the constant approximating 
values used in the seven flight intervals. 


COLLECTION OF ASSUMPTIONS ON BENDING MOMENT 

The significant assumptions on bending moment are summarized here. Bending 
moment was computed according to Equation (12). Peak values of M^ and M^ 
at each instant of time (either given or estimated as described earlier in this 
section under headings: M^ at CG versus Time and M^ at CG versus Time) 
were used. Thus, an estimate of the peak bending moment on the structure 
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Dimension of vertical scale: (M^ m-kg / rad) 10“ 


Horizontal Scale: 8 sec/div. 



Figure 6. Maximum of Bending Moment Coefficient M’u 
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Dimension of vertical scale: (M^ m-kg/rad) 10 



t (SEC) 


Figure 7. Maximum of Bending Moment Coefficient M’jS 




at each instant of time was used in formulating control criteria. It is of 
interest to note that supplementary data on peak values of and which 
was received too late to be used in the computations shows the assumptions 
outlined under headings at CG versus Time and at CG versus Time 
to be substantially corrept, although the values of M^ should have been more 
nearly constant., 


BENDING MOMENT IN THE NOTATION OF SECTION II 


Bending moment can be expressed in terms of state variables and disturbance 

winds V by substituting (10) and (11) into (15) for /3 and a respectively. The 
w 

result is (15A). 


M, 


[< m ; + k i 


k 2 m' 


<- m ; + k 3 m b> 


“1 

1 

o- 

1 


0 

- 

Z 


, (M « - K 3 M 6> v 

V W 


(15A) 


This equation shows explicitly how bending moment will depend on the con- 
troller gains K^, K K^. 
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SECTION V 


CHOICE AND INTERPRETATIONS OF 
WEIGHTING VECTORS 


To facilitate interpretation of the weighting vectors d(i) and f(i) defined 
in (8), additional notation conventions will be adopted. Recall that: 1) n 

is the number of components in the state vector (i. e. , n is the dimension 
of the state space), 2) each d(i) is an n-vector, 3) each f(i) is a k-vector, 
and 4) there is a total number s of each (i. e. , 1 = 1 , 2 ,..., s). Assume 
that s ^ n so that there are at least as many cost elements C^ as the dimen- 
sion of the state space. Then assume that the first n of the d(i)*s and f(i)*s 
are the weighting vectors for the state variables taken individually. More 
complicated cost criteria will be assigned index values i > n. 


INTERPRETATION OF d(i), f(i), i = 1,2 ,n 

To weight only a particular state variable x., begin by defining (in (8)) 
e.(i) = 1 i £ n 

e.(i) = 0 j = 1,2,... , n + k, j ^ i. 

This choice of e.(i)*s merely selects the state variable x. as the one to be 
3 J i 

considered. 


A simple and illustrative method of weighting is to require that for a 
given value N of the control cost C, the amplitude of x^ should not exceed 
some specified amount ! x jl max * This is easily accomplished by selecting 
the scalar according to the rule; 


D. 

l 


-KL 


l max 


(16) 
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Thus, the forms of d(i) and f(i), Ui ^ n, which give cost C = N when 

has maximum amplitude lx. I is 
r ■ 1 1 max 

To! 


d(i) - D. 


. and f(i) = 0 

0 

1 i-th row 
0 


L°1 

where is given by (16). 


Figure 8 illustrates the result on a three-dimensional state space of selecting 
d*s and f*s in this manner, but some general notation is retained. All cost 
elements C^, 1 ^ i ^ n for points x = (x^, • • • , x^, • • * , x^) inside the box are 
less than the specified cost N. Points on the face of the box normal to the 
x^ axis have one cost element which is equal to N. Points on an edge 
have two cost elements with value N and all three CJs are equal to N at the 
corners of the box. Thus, a controller which keeps all state variables in or 
on the box is one whose control cost C does not exceed the chosen value N. 


Note that the dimension of the box in the i-th direction is inversely propor- 
tional to [see ( 1 6) ] - Increasing the value of has the effect of reducing 
the maximum amplitude of the state variable x^ that can be allowed by a con- 
troller whose cost C is not to exceed N. Alternately, increasing in- 
creases the cost item associated with state variable x^ for a given set of 

There may be cases where it is not permissible for a given state variable 
to have the same maximum amplitude in both directions. For example, 
maximum down-elevator deflection on an aircraft may be more restricted 
than is up -elevator deflection. This situation can be handled by biasing 
the value of x. used in equations 4 and 16. 
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refer to the lower right front 
corner of the box 


Figure 8. State Space Box Determined by Control Cost N and 
Weighting Scalars Dj 



controller gains. Thus, a larger D., gives a larger weight to in deter- 
mining control cost C. 

Finally, if no restriction is to be placed on in determining an acceptable 
controller, simply let = 0. The effect is to stretch the state space box 
to infinite length in the x^ direction. 


INTERPRETATION OF d(i), f(i), n<iss 


Control cost elements C^, n< i £ s, which are linear combinations of two 
or more state variables will restrict the state space for a given cost N if 

is large enough. We will give a method of computing the smallest possible 
which puts further restrictions on the state space box (illustrated in 
Figure 8 for n = 3) and a given control cost C = N. 


As an example, consider the cost element C^, i > n, which is associated with 
a control law u given by (17). 

n 

u = E K. x. (17) 

j-i J J 


The e.(i)*s are specified according to the rule 


e j(i) 

* K r 

j = 1,2,. 

e.(i) 

3 

- 0 , 

j a n + 1 


( 18 ) 


Then f(i) = 0 and the argument in (4) is simply id(i) ■ xl. As with state 
variables, it is common to specify a maximum value lul for the control 
(for example, lul maybe allowable gimbal deflection). The !d(i) • xl 

IUctX 

in the cost item has the following form [where notation has been kept general 

rather than using the non- zero values for e.(i) given in (18)] : 

3 
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n 


!d(i) 


* x 


= ID. Y e.(i) x. I 
3=1 


= Id. u 


If D^ is chosen as before, i. e. , 


D. = t- 
i lu 


N 


max 


we again have = N when lu 


lu 


max 


( 19 ) 


It remains to see what this cost item does in the way of restricting the state 

n 

space box. The control u = ^ e^(i) x j defines a family of parallel planes* 

in the state space. The two planes which represent maximal control are given 
by 

n 

Y e.(i) x. ± lu! = 0 (20) 

] j max 

3 = 1 

Noting (19) and (20), it is seen that these two planes correspond to a cost item 
C^(u) = N and can be written as 

n 

E f’v i?r 0 <2i) 

The two planes of the same family which pass through corners P and 
the state space box of cost N or less (Figure 8) are represented by 
n 

e.(i) x. ± h = 0 
3 1 

j=i 


V The word "plane" has been used throughout, rather than the correct term 
"hyperplane". 



-P of 


( 22 ) 
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where h is the distance from the origin to these planes (a formula for 
computing h is given in (25)). Comparing (21) and (22) one sees that con- 
trol planes of cost N pass through corners of the state space box of cost 
N if h = N/D.. If N/D. > h, the planes of maximal control ((20) and (21)) 
lie outside the box. If N/D^ < h, the maximal control planes cut corners 
off the box and further restrict the state space which was established by- 
allowing cost N or less on individual state variables. Therefore, all 
values of D., i > n, which satisfy (23) put further restrictions on the state 
space box of cost N. 

N 

D. > (23) 

l h 


There remains the need for computation of h. Let P = P(X^, • • • • , X^) 

denote one of the corners of interest on the state space box. It is clear 

from (16) and from Figure 8 that lX.l = lx. I = N/D., i = 1, 2, • • • , n. 

& j ] max j J 


The usual formula for the distance h to the plane through P = P(X^, * • , X., • • • 
is 



(24) 


But, we know only |X^ | and must determine its sign in order to compute h. 

This is done simply by noting that the direction numbers of the normal to 

every plane of the family are e.(i) so that all X.*s will have either the same 

1 3 

or the opposite sign of the direction number with corresponding subscript. 
Thus, each summand in the numerator of (22) is either positive or negative. 
Therefore, without knowing the sign of X., h may be computed as follows: 


h 


(25) 



COST ITEMS DEPENDING ON STATE VARIABLES AND DISTURBANCES n <i * s 


Cost items which depended on a linear combination of two or more state 
variables were considered in the preceding section. It is frequently neces- 
sary to consider disturbances in control cost items also. For example, 
cross wind velocity V occurs in both the controller equation (10) and the 
bending moment equation (15A) in the formulation of the launch booster 
problem of this report. In such cases, the f*s are no longer zero. As 
an illustration, assume that bending moment is to be considered in the 
(n + 2) -th cost item. Since n = 3 and k = 1 in this example, we have 


and 


ei (5) = M a + 

e 2 ^ ~ ^2^/3 

e 3 (5) = -(M^ + K 3 M^)/V 
/ / 

e 4 (5) = <M ff + K 3 M„)/V 


d<5) = D, 


/ / 

M + K n M q 
a 1 P 


K 2 M 0 

•(M ff + K 3 M j3 )/V 


• «5) = D 5 [( M j + K 3 M^)/v] 
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The additional cost due to consideration of non-state variables is given 
by the^last terin of (4A); that term is maxjf(i) • g| in general notation and 

V w | in the case of bending moment. This addi- 


[< M « 


+ k 3 m^ 


)/v] 


max 


tional cost should simply be omitted in considering the effects of a particular 
d(i) on the state space box of cost N (the vector f(i) does not affect it). 

The computations of the preceding section then apply directly. 


INTERPRETATION OF COST ITEMS DEFINED BY (4) AND COMPUTED BY (4A) 

The cost items defined by (4) and computed by (4A) can now be conveniently 
interpreted by a third equation. It has been shown that the e^.(i)*s serve to 
select the quantity of interest and that the D^*s determine the weights to be 
given the individual quantities. Thus, if y^ denotes a quantity of interest, 
the corresponding cost item C^ has the meaning shown in (26). 


C. = max max I D. y. 
l i J i 

[o,t] geG 


(26) 


If one agrees to remember that each cost item has been maximized by the 
worst disturbance of the assumed class for that particular quantity, and 
that the cost item has also been maximized over the finite time interval of 
interest, then some of the notation of (26) can be suppressed to give the 
simple formula (27). This form 


C. 

l 


D. | y. | 
l max 


has already been suggested by (16) and (19). 


(27) 
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WEIGHTING VECTORS AND SCALARS SELECTED 


Five cost items were selected for the problem outlined in Sections III and IV. 

Table 4 shows the items (in the notation of (27), together with the definitions 

of e.(i)*s and D.'s. Values of V for the fourth and fifth columns of e„(i) and 
3 1 / ^ / 

e^(i) are obtained from the bottom half of Figure 4. Values of M^ and 

for the fifth column of the e^.(i)’s come from Figures 6 and 7, respectively. 

Data was supplied by Marshall Space Flight Center which included responses 
of Model Vehicle No. 2 to wind disturbances when equipped with a drift- 
minimum controller. The "synthetic wind profiles" (as described in Appen- 
dix A of the data package) had peak velocities at 40, 48, 56, 64, 72, 80, and 
88 seconds. Two cases were considered for the flight interval containing 
t = 48, one with gusts and one without. The values of the weighting scalars 
were selected for each flight interval so that maximum responses of the 
vehicle for wind profiles appropriate to that interval all had the same cost. 
Then the resulting bending moment weights D,. were doubled, while the 
others were left unchanged. The bottom half of Table 4 shows the D.*s for 
each flight interval. D 2 was initially chosen as zero (so C 2 = 0) since expli- 
cit pitch rate responses were not given. D^ was later given a small weight 
(D 2 - 0. 01) in order to obtain non- zero values of cost item C 2 and conse- 
quently be able to compute maximum pitch rates. 

The method of choosing the D^*s accomplished two objectives: 

• The method distributed the weights with some recognition 
of physically realistic values, and 

• The method enabled the resulting cost items to be compared 

directly and interpreted against a known allowable number 

(e.g. , if D. = yr , then D i * ly.l £ 1). 

M, max 
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Table 4. Cost Items and Weight Vectors 


i 

1 

2 

3 

4 

5 

HSU 

<j> rad 

. 

<t> rad /sec 

• 

Z m/sec 


Mg m-kg 

e j(i) 

1 

0 

0 

K i 

M' a 4- KjM’g 

e 2 tt) 

0 

1 

0 

K 2 

k 2 m , )3 

e 3 (i) 

0 

0 

1 

k 3 /v 

-(M l a + KgMy/V 

e 4 (i) 

0 

0 

0 

- K 3 /V 

(M’ a + KgM'^) /V 

Scalar 







D, 

n ** 

D 0 

n 

D, 

Interval 

1 

2 

3 

4 

5 

! i 

0. 978 

o 

0 . 01 

0. 0342 

1. 56 

0. 674 x 10“ 7 

: 2 

0. 9^8 

0 

0 . 01 

0. 0342 

1. 56 

0. 398 x 10“ 7 

: 3 

0. 645 

0 

0.01 

0. 0262 

0. 838 

0. 166 x 10“ 7 

J 4 

0. 529 

0 

0. 01 

0. 0188 

0. 684 

0. 120 x 10“ 7 
- 7 

>5 

0. 499 

0 

0. 01 

0. 00859 

0. 763 

0. 104 x 10 

_7 

! 6 

0. 415 

0 

0. 01 

0. 0143 

0. 608 

0. 0928 x 10 

-7 

l l 

0. 493 

o 

0. 01 

0. 0314 

0. 469 

0. 1072 x 10 


*C. = D. |y. 1 
i i 'max 

**When = 0, then = 0. If C ^ / 0, then = 0. 01. 






SECTION VI 

ITERATIVE INITIAL USE OF MINIMAX COST COMPUTATIONS 


INTRODUCTION 

The minimax theory gives a computation procedure for identifying the com- 
bination of controller gains for which the cost of control of a linear system 
subjected to maximum disturbance inputs is minimum. A systematic use of 
this computation -procedure is desirable. One procedure that has been evolved 
is described here. The method amounts to evaluating control costs for a 
selected set of controllers, and then using this information to select a new set of 
controllers, some of which have costs less than any in the preceding set. 

Several iterations of this procedure have been found useful in that each iter- 
ation has yielded controllers whose costs were lower than any previously 
considered controller. Each controller was employed for only one of the 
seven flight intervals. The duration of each interval ranged from 8 to 20 
seconds. At any state of iteration of minimax computations, the minimax 
controller for a given interval is the one of those considered with the lowest 
control cost. 

The primary goal was to study the applicability of minimax theory to selec- 
tion of controllers, so no restrictions (such as asymptotic stability) were 
placed on the class of controllers to be considered and no attempt was made 
to devise automatic numerical techniques of determining lowest cost con- 
trollers. Some consideration of restricting the class of possible controllers 
is contained in Section IX, but no computations were done with such 
restrictions employed. 
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THE PROBLEM CONSIDERED 


The mathematical model used was the same as outlined in Sections III and IV. 
The controller class is defined by (10) and a particular controller is therefore 
specified by three values of the gains K^, Kg and Kg . The following discus- 
sion is directly applicable to this situation, but n-dimensional notation is 
employed with geometric examples shown in three dimensions. 

It will be assumed that the control criteria and weighting vectors have been 
chosen so that cost elements C^(u) of (4) are defined. The gain space K is 
the n-dimensional space whose points K are the n-tuples of numbers K^, 
j = l, 2, . . . , n which comprise one combination of controller gains: 

(K x ,K 2 , . . . ,K n ) = K e K. 

A controller is assumed to be completely specified by selecting a point K. 
Thus, it is not ambiguous to speak interchangeably of a controller u - u(K) 
and a point K in gain space K . 

The problem at hand is outlined as follows: 

i) For each K e K (i. e. , for each combination of controller 
gains) there are s cost elements C. , i-1, 2, . . . , s and the 
largest one is the cost C(u) of that controller. 

ii) The cost C(u) is determined by different cost elements 
C^(u) in various parts of the gain space K . 

iii) It is desired to locate the point K for which C is minimum. 
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A PROCEDURE 


The first objective of this procedure is to establish a region in the gain 
space K which contains the low cost controllers in its interior . The second 
objective of the procedure is to search the interior of the region for the best 
controller. 

Minimax design calculations were carried out for seven subintervals of the 
powered flight of a (third order linearized) large launch booster. It was 
noted in Section III that the coefficients were constant in each interval and 
that the coefficient matrices of the vehicle's equations of motion were sub- 
stantially different from one interval to another. The experience gained in 
these calculations led to the following procedure: 

1. Choose a first set of gains = (K^, . . . , K^) by any rea- 
sonable means. 

2. Pick a box in gain space of generous size by selecting a 
couple of values of each gain on both sides of those in K*. 

Use all combinations of the selected values to define a grid 
of points uniformly distributed in the box. 

3. Compute the cost of control for the points of this first grid 
and see where a few of the lowest cost controllers fit in the 
grid. 

4. If any particular gain BL is inside the box for the low cost 
controllers, this seems to be an indication of a somewhat 
critical range of values for that gain, and a second grid 
with a refinement and reduced range of values in the j-th 
direction in gain space should be selected and the compu- 
tations repeated. 
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Interior Refinement 


It is reasonable to expect that at some stage of grid refinement, the lowest 
cost controller lies inside the most recent gain box. Assuming that a cost 
reduction or gain change criterion has not yet indicated completion of attempts 
at improvement, an interior refinement procedure has been evolved. It con- 
sists of picking a reduced range for each gain and establishing a grid which 
has this lowest cost controller on its interior. Repeating the cost computa- 
tions is a means of conducting a search for a better controller in the vicinity 
of the best previous controller. 

It is conceivable that interior refinement would be required in the vicinity of 
several different controllers which were not particularly close together in the 
gain space K. Limited experience indicates that it is more likely that sev- 
eral good controllers are clustered together and that an interior refinement 
is conducted in a box which contains all of them. 

A graphical technique has been found helpful in choosing refined grids in 

particularly critical cases. It is discussed in the section entitled Cost 

\ 

Mapping^ 


Summary of Experience 


Before going on, the experience for the example studied will be summarized. 
The criteria which were adopted for considering a grid refinement to be 
complete were that decrease in cost and/or the changes in gains from the 
most recent grid should not exceed 10 percent. 


Three gains were involved in the case considered. In attacking the first 
objective, an initial point = (K^K^K^) in K was chosen based on 
gains supplied by Marshall Space Flight Center for a drift minimum con- 
troller of a similar vehicle. The gains FL represent feedback gains for 
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pitch attitude <f>, pitch rate 0, and lateral velocity Z, respectively. An 
initial box in K was chosen as the box centered at the origin of K whose 
sides were of length 4 k|, 4K 2 , anc * ^3* figure ® illustrates this original 
box of controllers with K 1 inside of it. 


Five values were chosen for each controller gain K^. They were K. s 0, 

K. = ± K.\ and K. = ± 2k\ where j = 1, 2, 3. All combinations of these 
J J 3 3 

values represent a grid of 125 controllers which lie at the corners of the little 
boxes subdividing the initial box (see corner A in Figure 9). The costs for 
these controllers were computed for each of the seven flight intervals and 
a few of the lowest cost controllers for each interval were selected for 
further study (Refer to Table 5). The cost elements CT, i = 1, 2, 3, 4, 5, 
represented respectively the following variables: 1) pitch attitude </>, 

2) pitch rate <f > , 3) lateral velocity Z, 4) gimbal angle and 5) bending 

moment M_. A strong pattern was immediately apparent. The maximum 

ID 

values of and Kg and the zero value of Kg were very popular among 
the low cost controllers and the controlling cost was almost always on 
lateral velocity (Cg). This was not surprising since the method of choosing 
Dg would inherently weight lateral velocity rather heavily. Only interval 
7 is exceptional to this summary, in that the cost was on bending moment 
(C^) and Kg was negative. 


Since the best controllers were clustered near the front and right faces of the 
box at about zero height (Figure 9), and since the only non-zero values of Kg 
which were selected were negative, a second box of about the same size and 
subdivisions was chosen with its center closer to K^. (It was at (4. 5, 10, 

-0. 7)). These results are in Table 6 and can be summarized in exactly the 
same way: Maximum values of and Kg and zero values of Kg were 
popular with the low cost controllers, and the cost was almost always on 
lateral velocity (Cg). In interval 7, the negative value of Kg closest to 
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Table 5. Control Costs - Initial Gain Grid 


Gain 


V alues 



K i 

9 0 2 

4. 6 

0 -4. 6 

-9.2 


K 2 

10 

5 

0 -5 

-10 


K 3 

0. 8 

0, 4 

0 -0. 4 

-0.8 


Interval 

Cost = C(K 

V K 2* K 3^ 

Interval 



C 3 (9.2, 

10, 0) 

= 0.02153 


Cg(9. 2, 0, 0) = 0. 06017 

r i 

C 3 (9.2, 

5, 0) 

= 0.02155 

h 

Cg(9.2, 10, 0) = 0. 06019 


C 3 (4 0 6, 

o 

O 

= 0. 02226 


C 3 (9. 2, 5, 0) = 0.06019 


C 3 (9o 2, 

10, 0) 

= 0. 0736 


Cg(9.2, 10, 0) = 0.1026 

eg 

C 3 (9. 2, 

5, 0) = 

0. 0737 

h 

Cg(9.2, 0, 0) = 0.1026 


Cg(9, 2, 

0, 0) = 

0. 1139 


C 3 (9. 2, 5, 0) = 0.1028 


Cg(9.2, 

10, 0) 

= 0.1552 


C,-{4. 6, 10, -0.4) = 0.1493 

CO 

1 

Cg(9.2, 

5, 0) = 

0. 1554 

1 7 

C 5 (9.2, 10, -0.4) = 0.1575 


Cg(9.2, 

0, 0) = 

0. 1562 


Cg(4. 6, 5, -0.4) = 0.1706 


C 3 (9.2, 

0, 0) = 

0. 09480 


C 5 (9. 2, 5, -0. 4) = 0. 1884 

*4 

C 3 (9. 2, 

10, 0) 

= 0.09497 




C 3 <9 0 2, 

5, 0) = 

0. 09502 
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Table 6. Control Costs - .Second Gain Grid 


Gain 



Values 



K i 

13. 5 

9. 0 

4. 5 

0 

-4. 5 

K 2 

20 

15 

10 

5 

0 

K 3 

0. 7 

0 

i 

o 

. 

-j 

-1.4 

-2.8 


Interval 

Cost = C(K 1# K 2 ,K 3 ) 

Interval 



C 3 (13. 5, 20, 0) = 0. 02126 
C 3 (13. 5, 15, 0) = 0.02127 
C 3 (13. 5, 10, 0) = 0.02128 
C 3 (13. 5, 5, 0) = 0.02129 

*5 

Cg(13. 5, 20, 0) = 0. 06015 

C 3 (13. 5, 15, 0) = 0. 06015 

C 3 (13. 5, 10, 0) = 0. 06016 

C 3 (13. 5, 5, 0) = 0. 06016 
C 3 (13. 5, 0, 0) = 0. 06016 

l 2 

C 3 (13. 5, 20, 0) = 0. 07265 
Cg(13.5, 15, 0) = 0. 07270 
C 3 <13. 5, 10, 0) = 0. 07273 
C 3 (13. 5, 5, 0) = 0. 07277 

CO 

hH 

C 3 (13. 5, 0, 0) = 0. 1010 
C 3 (13. 5, 20, 0) = 0.1012 
C 3 (13. 5, 15,0) = 0.1013 
C 3 (13. 5, 10. 0) = 0. 1014 
C 3 (13. 5, 5, 0) = 0. 1015 

h 

C 3 (13. 5, 20, 0) = 0. 1532 
C 3 (13. 5, 15, 0) = 0.1533 
C 3 (13. 5, 10, 0) = 0.1534 
C 3 <13. 5, 5, 0) = 0. 1534 


C 5 <0, 15, -0.7) = 0.1100 
C 3 (0, 15, -0.7) = 0.1142 
C 3 (4. 5, 5, -0. 7) = 0. 12.55 
C 3 (0, 20, -0. 7) = 0. 1263 

h 

C 3 (13. 5, 20, 0) = 0. 09460 
C 3 (13„ 5, 15, 0) « 0.09463 
Cg(13. 5, 10, 0) = 0. 09465 
C 3 (13. 5, 0, 0) = 0.99466 
C 3 (13. 5, 5, 0) = 0.99467 
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zero was chosen, and the control was on bending moment. Furthermore, the 
highest of the four or five lowest costs in the grid on the second box were 
lower than the lowest costs on the grid in the first box. 

At this point, these observations were made: 

1) Negative values of and K g and to a less marked degree, 

positive values of Kg were not used in the best controllers. 

This was anticipated, but the computations served to verify 
that a sign reversal had not occurred in selecting the initial 
point K^. 

2) The low cost controllers contained values of K. and K 9 

*■ ^ i 

which substantially exceeded those anticipated in choosing K . 

3) The low cost controllers always had Kg (the lateral velocity 
feedback) equal to zero or the negative value nearest zero. 

Yet the cost was almost always determined by the lateral 
velocity cost element Cg. 


It was concluded that the range of values on Kg was too broad. A refinement 
was made by picking a third box of controllers with the same K 1 and Kg 
ranges in the second box but with the Kg dimension reduced by 1/57. 3. * This 
third box is contained within the second one. Numerical results are in Table 7, 
and this choice of gain grid is seen to be rewarding in several ways: 

1) In the best controllers from the third grid, 65 percent of the 
values of K^ and 3 6 percent of the values of Kg were on a 
face of the box. The corresponding numbers for the second 
box were 82 and 41. 


*This constant was chosen because not only was the range of Kg reduced, 
but also it seemed a convenient check of whether or not values of Kg had 
been too large because of an error in dimension. This possibility was 
subsequently eliminated. 
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Table 7. Control Costs - Third Gain Grid 


Gain 

K i 

K 2 

K 3 

Values 

13. 5 9.0 4. 5 0 -4.5 

20 15 10 5 0 

•0. 0122 0 -0. 0122 -0. 0245 -0.0489 

Interval 

Cost = C(K p K 2 , K 3 ) 

Interval 


i 1 

t-H 1— 1 

to (-> 

Cg(13. 5, 20, 0) = 0. 02126 
Cg(13. 5, 15, 0) = 0. 02127 
C 3 (13. 5, 10, 0) = 0. 02128 
C 3 (13. 5, 5, 0) = 0.02129 

in 

i 

C 3 (0, 0, -0. 0245) = 0. 03906 
C 3 (0, 0, -0. 0122) = 0. 05050 
C 3 (0, 5, -0. 0489) = 0. 05215 
Cg(-4. 5, 15, -0.0489) = 0.05387 

C 5 (0, 5, -0. 0489) = 0. 05038 
C 5 (0, 10, -0. 0489) = 0. 05056 
C 3 (-4. 5, 20, -0. 0245 = 0. 05068 
C 5 (0, 15, -0. 0489) = 0. 05085 

1 6 

Cg( 13. 5, 0, -0. 0489) = 0. 09989 
C 3 (13. 5, 20, -0. 0489) = 0. 09996 
C 3 (13. 5, 15, -0. 0489) = 0. 09999 
C 3 (13. 5, 10, -0. 0489) = 0. 1000 

*3 

C 3 (-4. 5, 15, -0. 0245) = 0. 1125 
C 3 <-4. 5, 20, -0. 0489) = 0. 1307 
C 3 (0, 5, -0. 0489) = 0. 1329 
C 3 (0, 15, -0. 0489) = 0. 1443 


C 3 (13. 5, 0, -0. 0489) = 0. 2253 
Cg(13. 5, 20, -0. 0489) = 0. 2261 
Cg(13. 5, 15, -0. 0489) = 0. 2264 
Cg(13. 5, 0, -0. 0245) = 0. 2264 

h 

C 3 (0, 0, -0. 0245) = 0. 07076 
C 3 (0, 0, -0. 0489) = 0. 07283 
C 3 (-4. 5, 10, -0. 0489) = 0. 07288 
Cg(-4. 5, 5, -0. 0245) = 0. 07427 
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2) 


In every interval except the first and seventh, the poorest of 
the low cost controllers selected in the third grid had lower 
cost than the best one selected in the second grid. Con- 
trollers and costs were the same in the first interval. The 
good controllers in the seventh interval were poorer with the 
third grid than with the second, and it was (correctly) antici- 
pated that the lateral velocity (Z) feedbacks allowed by the 
small values of Kg in the third grid were too small compared 
to the value of Kg = -0. 4 which gave the best controllers 
in the second grid. 

3) In the third grid there was more variation from interval to 
interval in what constituted the best controller than had been 
true in the first two grids. This was subjectively regarded 
as a good omen because of the variations in coefficients of 
the equations of motion from one interval to another. 

4) In the low cost controllers from the third grid 60 percent of 
the values of Kg were on a (bottom) face of the box for the 
first time. This indicates that the refinement of values of 
Kg in going from the second box to the third was too severe. 
The first three observations about the third grid still show 
that refinement of the range of values of Kg was the correct 
procedure and that the values of Kg are apparently rather 
critical. 


COST MAPPING 

When the selected gains were all interior to the grids offered, the need for a 
judicious choice for the range of a given gain grid became pre-eminent. Any 
technique developed had to recognize the interdependence of each gain on the 
values of the two remaining. 
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The five cost elements were plotted as functions of an individual gain with 
the remaining two gains fixed at their last selected value. 

Such a two-dimensional graphing technique permits observing the range of 
the variable gain which provides the minimum of the maximum costs over the 
five cost items. Further, it permits subjective selection of that range of the 
particular gain being considered which should be most competitive when com- 
bined with similar ranges of the other two gains. This information can be 
obtained by observing the rate of change of the maximum cost where it is 
minimum and determining the corresponding range of the independent gain. 

An example of cost mapping is shown in Figure 10. Only the controlling costs 
items are shown. The remaining costs items would fall substantially below 
those shown. 

In this case, the minimum of the maximum costs occurs on the range 

4. 75 £ kg ^ 8. 5, while the competitive range of k g might be 4. 5 <kg < 13. 5. 

(i. e. , k„ = C . ± 10# C . ). 

' 3 min min 

Experience has shown, however, that the upper limit can be lowered apprecia- 
bly because of the slow rate of change in this portion of the gain range. 

Not only is the graph helpful in establishing the range a gain grid should have; 
it also points out regions within the grid range where trial density should be 
heavier. 

In the example it would be informative to verify the flat cost at k 2 = 6 and 
kg = 7, and use the three remaining trial values to investigate rising costs 
near k„ £ 4. 5 and k„ s 8. 5. 
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SECTION VII 


MINIMAX, DRIFT MINIMUM AND OPEN-LOOP 
CONTROLLERS COMPARED 


After several iterations of minimax computations, the resulting minimax con- 
trollers for each flight interval were compared with the drift-minimum controller 
for the same interval and with the open-loop controller (K^ = K ^ - Kg =0). In 
all cases, the cost items and weights were those given in Section V under the 
heading. Weighting Vectors and Scalars Selected. 


COMPARISON BASED ON CONTROL COSTS 

Table 8 provides a basis for comparing controllers. The last three columns 
contain respectively the control cost items CL for the vehicle with "open-loop" 
control, with drift-minimum control, and with minimax control for each of 
the seven flight intervals. The first column of numbers repeats the scalar 
weights D^ from Table 4 assigned to each variable in determining costs. Since 
the same set of weights were used for each type of controller, the three 
cost items in any row of Table 8 are proportional to the maximum amplitude 
of the corresponding cost variable for maximum disturbance inputs (and the 
common constant of proportionality is the value of D. in the first column of 
the same row). Therefore, the performance of controllers for maximum dis- 
turbance inputs may be compared by comparing cost items C. themselves. 
Results for the vehicle with open loop control are discussed first. In each 
interval, the largest cost item CL, hence the cost C, is Cg (lateral velocity 
Z). It exceeds the second largest cost item, which is Cg (bending moment 
M-g) in 1^ and Ig and (pitch attitude 0) in the other intervals, by a factor 
of at least three. In summary, the uncontrolled vehicle has a lot of drift and 
"follows its nose" except near Mach 1 (1^, Ig), where it is more subject to 
bending. And since the vehicle is uncontrolled, (gimbal angle j3 ) is zero. 
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Table 8. Comparison of Controller Costs for Zero Initial 
Conditions on Each Interval 


Interval 

D. = a x 10* 3 

l 

C i 

Open Loop 

Drift - 
Minimum 

Minimax 


i 

a 

b 

i 




1 

0. 978 

0 

1 

0. 0629 

0. 00251 

0. 00103 


2 

1.0 

-2 

2 

0. 00006 

0. 00003 

0. 0000007 

X 1 

3 

0. 342 

-1 

3 

C = 0. 2074 

0. 00243 

C = 0.01630 

4 

0. 156 

1 

4 

0 

0. 04013 

0. 00208 


5 

0. 674 

-7 

5 

0. 0152 

C = 0.07383 

0. 01625 


1 

0. 978 

0 

1 

0. 1596 

0. 0096 

0. 01213 


2 

1. 0 

-2 

2 

0. 0002 

0. 0001 

0. 00001 

h 

3 

0. 342 

-1 

3 

0. 4911 

0. 0104 

0. 03752 


4 

0. 156 

1 

4 

0 

0. 1518 

0. 01261 


5 

0. 398 

-7 

5 

0. 0269 

C = 0. 1666 

0. 03762 


1 

0. 645 

0 

1 

0. 277 

0. 0152 

0.01439 


2 

1.0 

-2 

2 

0. 001 

0. 0003 

0.00007 

h 

3 

0. 262 

-1 

3 

C = 1.090 

0. 0214 

0. 04605 


4 

0. 838 

0 

4 

0 

C = 0. 1835 

0. 03148 


5 

0. 166 

-7 

5 

0. 043 

0. 1619 

C = 0.047 67 


1 

0. 529 

0 

1 

0. 0179 

0. 0172 

0. 01609 


2 

1. 0 

-2 

2 

0. 0001 

0. 0004 

0. 00007 

h 

3 

0. 188 

-1 

3 

C = 0. 1270 

0. 0238 

0. 04673 


4 

0. 684 

0 

4 

0 

C = 0. 1870 

0. 02615 


5 

0. 120 

-7 

5 

0. 0257 

0. 1576 

C = 0. 04737 


1 

0. 499 

0 

1 

0. 00364 

0. 0228 

0. 03800 


2 

1. 0 

-2 

2 

0. 00002 

0. 0005 

0. 00028 

h 

3 

0. 859 

-2 

3 

0. 06336 

0. 0153 

C = 0. 03953 


4 

0. 763 

0 

4 

0 

C = 0. 2931 

0. 02824 


5 

0. 104 

-7 

5 

0. 02889 

0. 1929 

0. 03790 


1 

0. 415 

0 

1 

0. 0709 

0. 0156 

0. 01680 


2 

1.0 

-2 

2 

0. 0005 

0. 0004 

0. 00006 

h 

3 

0. 143 

-1 

3 

C = 0.2430 

0. 0235 

C = 0. 05052 


4 

0. 608 

0 

4 

0 

C = 0. 1800 

0.03195 


5 

0. 928 

-8 

5 

0. 0428 

0. 1416 

0. 05037 


1 

0. 493 

0 

1 

0. 2023 

0. 0182 

0. 01806 


2 

1.0 

-2 

2 

0. 0013 

0. 0004 

0. 00017 

i 7 

3 

0. 314 

-1 

3 

C = 0. 9338 

0. 0517 

0. 07738 


4 

0. 469 

0 

4 

0 

0. 1443 

0. 05747 


5 

0. 1072 

-7 

5 

0. 0668 

C = 0. 1662 

C = 0. 07878 


Notation 


C. 


D. 


y i 


y^ = 0 rad, = 0 rad/sec, = Z m/sec 
y 4 = £ rad, y 5 = Mg m-kg 
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max 




The same vehicle with maximum disturbance and a. drift- minimum controller 
of course has low values of Cg. The penalty paid for this is that either 
C 4 (gimbal angle |3) or (bending moment Mg) cost items are dominant in every 
intervale Furthermore, the smaller of these two is always at least three 
times the third highest cost in each interval. Thus the drift- minimum controller 
calls for large gimbal deflections and causes large bending moments. Large 
values of each occurred in I,. and their magnitudes are computed from the data in 
Table 8 (in the 4th and 5th rows of 1^) as follows: 


le 


max 


0, 2931 
0, 763 


= 0 o 384 rad 


IM 


0. 1929 


6 


B * max 


0o 104 x 10 


-7 


18. 5 x 10 m- kg. 


These values are 4 0 4 times the desired maximum gimbal deflections of 0. 087 

g 

rad and 6. 8 times the desired maximum bending moment of 2. 7 x 10 m-kg. 
However, they correspond to exceedingly severe wind inputs. 

The last column of Table 8 contains the costs for the minimax controller for 
the weights listed in the D column. The first effect of applying the minimax 
calculations to gain sets successively chosen by the techniques lumped under 
the name grid mapping is that, in each interval, the highest cost item is 
reduced and one or more of the other cost items is increased until at least 
two cost items are approximately equal and greater than the remaining ones. 
Table 8 illustrates these properties. 

To see this, recall that the initial gain-sets were close approximations of 

the drift- minimum controllers. Then, for each interval, several iterations 

of cost reduction were effected by choosing successively new gain sets. 

Note that for the resulting minimax controller, Cg — C,_ in every interval. 

Furthermore, the minimax values of CL and C c are never as much as half 

o 5 

the cost of control for the drift- minimum controller. 
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Since gimbal deflection and bending moment are large together, it is no surprise 
that is usually of the same magnitude as in the minimax column of Table 8. 
Furthermore, since the drift- minimum costs have shown low bending moment 
and low drift to be somewhat antithetical requirements, it can be expected that 
Cg and Cg would be the controlling costs in a design which weighted these two 
factors heavily. 


Finally, interval- 5 cost items for the minimax controller correspond to the 
following maximum values of the cost variables: 

I? Ux ■ - 9! 0 °. 2 7 8 6 2 3 4 * °- 037 rad < 087 rad * 


M 


0. 03790 


B 1 max 


0. 014 x 10 


-7 


= 3. 64 x 10 m-kg. 


It is seen that the maximum gimbal deflection for this minimax controller is 
well below the desired value of 0. 087 rad and that maximum bending moment 
is only 1.35 times the desired maximum value. The price paid for this per- 
formance is that the maximum lateral velocity in 1^ is 2. 6 times as large 
for this minimax controller as for the drift- minimum controller. It cannot, 
however, be concluded that drift is 2. 6 times as high. It has not been deter- 
mined (but could be) whether or not the lateral velocity changed sign often, 
etc. during the response in which it achieved its maximum value. 


COMPARISON BASED ON EIGENVALUES 

Table 9 lists the gains and eigenvalues of the three types of controllers consid- 
ered. It is known that drift- minimum controllers have one closed loop pole 
at the origin. The drift- minimum gains were chosen to give an undamped natural 
frequency of 0. 2 cycles per second and a damping ratio of 0. 7. This choice 
would lead to the two non-zero eigenvalues (closed-loop poles) of -0. 8796 ±i 0. 897 3. 
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The fact that the eigenvalues in the Drift- Minimum column of Table 9 deviate 
slightly from this indicates minor errors in the drift- minimum gains 
Kp K 2 , and Kg. 

The open loop column of Table 9 shows the eigenvalues of the uncontrolled 
vehicle in each interval. One positive eigenvalue in each interval shows that 
the vehicle is asymptotically unstable all the time. 

The minimax controllers (last column of Table 9) are seen also to have one 
positive eigenvalue in each interval; but, except for I,., this positive eigenvalue 
is much smaller than for the uncontrolled vehicle. Since bending was weighted 
heavily in this minimax controller, and since the (stable) drift- minimum con- 
troller gave very high bending moments in I,., it is thought that the relatively 
large positive closed -loop pole in the minimax controller for 1^ is no accident. 
That is, in order to minimize bending it may be desirable to use a controller 
which is not asymptotically stable for a short period of time which includes the 
event of Mach 1. On the other hand, it is expected that further application 
of the minimax technique when cost variables have non- zero initial conditions 
will result in asymptotically stable controllers for most intervals. This aspect 
of the study will not be considered further in this report. 


COMPARISON BASED ON GAINS 

A drift- minimum controller is designed to hold rather closely to a given 
trajectory and has been shown to call for large gimbal deflections and to 
cause large bending moments. One might guess that a controller which would 
keep bending moments small would have lower gains than the drift- minimum 
controller. Figure 11 shows that this is indeed the case for the drift- minimum 
and minimax controllers having gains listed in Table 9. It should be 
emphasized, however, that iterative use of the minimax calculations yields 
values of gains for the (expected) lower gain controller which minimizes the 
control cost. 
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Table 9. Comparison of Controller Eigenvalues 



OPEN LOOP 

DRIFT MINIMUM 

MINIMAX 


GAINS 

EIGENVALUES 

GAINS 

EIGENVALUES 

GAINS 

EIGENVALUES 


K I 

0 

. 072931, 

K 1 

4. 3 

0 

K 1 

. 01 

. 00522 

*1 

K 2 

0 

03739 ± 

K 2 

5. 025 

88296 ± 

K 2 

3.0 

-. 00966 


K 3 

0 

i. 0525 

K 3 

-. 0446 

i. 85329 

K 3 

0044 

-1. 1048 


K 1 

0 

. 11387, 

K 1 

4. 26 

0 

K 1 

3 

. 07072 

l 2 

- K 2 

0 

05932 ± 

K 2 

4, 751 

88006 ± 

K 2 

4. 6 

-. 01180 


K 3 

0 

i. 06361 

K 3 

204 

i. 88931 

K 3 

-.0275 

-1. 1750 


K 1 

0 

. 15111, 

K 1 

4. 0 

0 

K 1 

. 6 

. 00143 

*3 

K 2 

0 

08099 ± 

K 2 

4. 422 

87997 ± 

K 2 

3. 2 

-. 22755 


K 3 

0 

i. 04917 

K 3 

-. 514 

i. 89004 

K 3 

-.115 

-1. 0382 


K 1 

0 

, 93331, 

K 1 

3. 68 

0 

K 1 

. 28 

. 01268 

*4 

K 2 

0 

05387 ± 

K 2 

4. 099 

-. 87967 ± 

K 2 

3. 0 

-. 12597 


K 3 

0 

i. 03396 

K 3 

-. 638 

i. 88965 

K 3 

-. 11 

-1. 1651 


K 1 

0 

. 04229, 

K 1 

3. 68 

0 

K 1 

-1. 5 

. 34900 

*5 

K 2 

0 

02899 ± 

K 2 

4, 098 

88063 ± 

K 2 

3. 5 

-. 01801 


K 3 

0 

i. 01765 

K 3 

867 

i. 89216 

K 3 

055 

-1. 1818 


K 1 

0 

. 18582 

K 1 

, 3. 4 

0 

K 1 

0 

. 04736 

Z 6 

K 2 

0 

-. 04228 

K 2 

3. 757 

88026 ± 

K 2 

3. 7 

-. 04319 


K 3 

0 

15427 

K 3 

805 

i. 88524 

K 3 

19 

-1.7248 


K 1 

0 

. 27290 

K 1 

3. 5 

0 

K 1 

1. 25 

. 00238 

l l 

K 2 

0 

03688 

K 2 

3. 756 

87996 ± 

K 2 

4. 0 

-. 35442 


K 3 

0 

24546 

K 3 

975 

i. 89022 

K 3 

-. 475 

-1. 5106 
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SECTION VIII 


REDUCTION OF MINIMAX GAIN 
CHANGES BETWEEN FLIGHT INTERVALS 

Figure 11 shows rather large differences in gains and Kg between 1^ and Ig 
and between Ig and Ig. Since the coefficients of the plant all were smooth and 
monotone throughout 1^, I and most of Ig, it was anticipated that values of 
and Kg in Ig more in line with those in 1^ and Ig might lead to lower costs. 

A set of controllers which were similar to, but with slightly higher costs than 
the minimax controllers in Figure 11 was selected as the starting point. 

Figure 12 shows the gains of these selected controllers as the horizontal line 
segments which are not connected. The values of these gains, the corresponding 
costs and closed-loop poles are also listed in the left half of Table 10. 

The following qualitative comparison of these controllers and the open loop data 
in adjacent intervals motivated this part of the study. 

A. All coefficients of the open loop equations of motion are monotone 
throughout 1^, Ig, and almost all of Ig (Figures 1 through 3 are 
graphs of these coefficients); but 

1) K 1 < 0 in Ig while K^ > 0 in and Ig, and 

2) Kg is much larger in I 9 than in either 1^ or Ig. 

B. Comments similar to those in A for Ig are applicable for Ig. 

C„ In Ig, K^ has a comparatively large negative value and a closed 
loop pole at +0. 34560. Since the event of Mach 1 occured in Ig, 
a negative K^ is not necessarily bad, but further grid mapping 
might lead to minimax controllers which have lower costs and 
which are less unstable. 
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t (SECONDS) 



Figure 12. Two Sets of Controllers With Similar Costs 






Table 10. Gains, Costs, and Closed-Loop Poles of Controllers 
in Figure 12 



J INITIAL SET OF CONTROLLERS 

controllers with reduced gain 
CHANGES BETWEEN INTERVALS 

GAINS 

COSTS (D 2 =0) 



GAINS 

| COSTS 


i 

c. 

1 


i 

c. 

1 



K 1 

.04 

i 

. 00107 

.00246 

K 1 

.006 

i 

.00119 

. 00640 




2 





2 

.0000007 


J 1 

K 2 

3. 5 

3 

. 01598 

-.01526 

K 2 

2. 6 

3 

. 01566 

-. 00964 




4 

. 00219 




4 

.00204 



K 3 

004 

6 5 

C = . 01647 

-1.2146 

K 3 

-. 0044 

5 

C =.01624 

-. 90913 


K 1 

-. 5 

1 

. 01352 

. 08648 

K 1 

0 

1 

.00967 

. 02264 




2 





2 

. 000007 


*2 

K 2 

6. 0 

3 

. 03835 

-. 01076 

K 2 

2. 7 

3 

. 03580 

-. 02414 




4 

. 01410 




4 

. 01125 



K 3 

03 

5 

C = . 03902 

-2. 2798 

K 3 

-. 025 

5 

C =.03608 

-. 99438 


K 1 

. 6 

1 

. 01608 

. 00313 

K 1 

. 6 

1 

. 01374 

. 00055 




2 





2 

. 00007 


*3 

K 2 

3. 5 

3 

. 04815 

20335 

K 2 

2. 8 

3 

. 04445 

-. 28190 




4 

. 03447 




4 

. 03030 



K 3 

125 

5 

C = . 05016 

-1. 1816 

K 3 

-. 11 

5 

C =.04641 

-.82678 


K 1 

. 2 

1 

. 01701 

. 02079 

K 1 

.28 

1 

. 01609 

. 01268 




2 





2 

. 00007 


*4 

K 2 

3. 5 

3 

. 04641 

-.09269 

K 2 

3. 0 

3 

. 04673 

12597 




4 

. 02822 




4 

. 02615 



K 3 

12 

5 

C =.04923 

-1. 4169 

K 3 

-. 11 

5 

C = . 04737 

-1. 1651 


K ! 

- 2.0 

' 1 

. 03190 

. 34560 

K 1 

-1.2 

1 

. 03002 

. 30809 




2 





2 

. 00020 


h 

K 2 

5. 0 

3 

C =.04001 

-. 01761 

K 2 

3. 2 

3 

C =.03939 

-. 01828 




4 

. 02746 




4 

. 02084 



K 3 

06 

5 

. 03888 

-2. 4454 

K 3 

-. 050 

5 

. 03863 

-1. 6509 


K 1 

0 

1 

. 01612 

. 04460 

K 1 

. 15 

1 

. 01587 

. 02659 




2 





2 

. 00006 


*6 

K 2 

4. 5 

3 

. 05066 

-. 04325 

K 2- 

3. 4 

3 

. 04959 

-. 06544 




4 

. 03579 




4 

. 03214 



K 3 

21 

5 

C =.05261 

-2. 0912 

K 3 

-. 19 

5 

C = . 05017 

-1. 5435 


K 1 

1.5 

1 

. 01611 

. 00067 

K 1 

1. 3 

1 

. 01686 

. 00076 




2 





2 

. 00018 


*7 

K 2 

4. 5 

3 

. 08109 

-. 37924 

K 2 

3. 4 

3 

. 07417 

-. 51510 




4 

. 06083 




4 

. 05525 



K 3 

-. 50 

5 

C = . 08129 

-1. 7151 

K 3 

-. 45 

5 

C = . 07525 

-1. 0713 















ew gain-grids were chosen for each interval with a veiw to reducing costs 
id reducing gain changes between intervals. This first iteration of minimax 
imputations met with substantial success in the two worst intervals (Ig and I,.), 
he results at this stage were the controllers which were compared with the 
'ift minimum controllers in Section VII. The corresponding gains, costs, and 
genvalues are found in Figure 11 and Tables 8 and 9. One more iteration of 
?id mapping was done in all intervals and two more were done in I I 4 # and 
,. A general trend was that each successive gain grid contained three or more 
mtrollers which had lower costs than the best controller in the previous grid 
>r that interval. The control cost reductions ranged from about one-half to 
ve percent each time with most reductions in the neighborhood of three percent, 
he closed -loop pole locations did not follow an unbroken trend. The final sets 
F controllers each had one positive eigenvalue, but it was less positive than 
le corresponding eigenvalue for the starting set of controllers in all intervals 
tcept 1^ and 1^. The gains, costs, and eigenvalues of the set of controllers 
here this study was terminated are shown in the right half of Table 10. These 
ains are shown graphically in Figure 12 as the horizontal line segments with 
Dnnected midpoints. It is seen that the large fluctuations in K ^ have been 
Liminated and that is monotbne increasing in the final set of controllers, 
he negative was eliminated in and was reduced in magnitude by 40 
ercent in 1 ^. Furthermore, the changes in gains between intervals were 
educed in almost every case, so that all three gain "curves" are smoother 
lan the initial ones. 


he total cost reductions in each interval were as follows: 


Interval 


Cost Reduction (percent) 
1.4 
8 . 1 
8 . 0 
3. 9 
1. 5 
4.8 
8. 01 
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It should also be mentioned that the best controller found for I in the grid 
mapping described in this section had control cost four percent lower than 
the controller actually shown in Figure 12 and Table 10. The higher-cost- 
controller was selected since it fit better into the demonstrations of gain 
change reduction, which was the purpose of this section. The lower-cost- 
controller is defined by K = (0. 25, 0. 20, -0. 095). It is seen that this would 
cause a sharp break in the curve at 1^ in Figure 12. 

The question arises as to whether or not one could achieve a reasonably 
smooth set of controller gains at a lower cost level. There is reason to 
believe that one could, since six of the lower-cost-controllers shown in 
Figure 12 occurred on a face or an edge of the box of controllers spanned by 
this grid. However, the cost reductions with each iteration of grid mapping 
are now slight and the ability to achieve gain smoothing without increasing 
costs has been demonstrated. 
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SECTION rx 


RESTRICTIONS ON THE CLASS OF 
ALLOWABLE CONTROLLERS 


The class of allowable controllers considered in this report is given by (2), and 
for the specific example by (10). It is a class of linear controllers with fixed 
gains over finite time intervals. It might be desired that further restrictions 
be placed on the class from which controllers are to be selected. In Section VII, 
Tables 8 and 9, two extremes were observed. The minimax controllers were 
selected solely on the basis of minimizing control cost in each (finite) flight 
interval. The resulting controllers all were asymptotically unstable, though 
only slightly so in all intervals except the fifth one. The drift minimum 
controllers were totally specified by the conditions that the controllers be drift 
minimum and have an undamped natural frequency of 0. 2 cycles per second 
with a damping ratio of 0. 7. Minimax computations showed these controllers 
to have substantially higher costs than the minimax controllers in each flight 
interval. 

It would be practical to impose conditions on the class of controllers which 
are intermediate between the two extremes of only cost minimization and total 
specification; however, imposing such restrictions would usually increase 
control costs. Examples of increasing degrees of restriction for controllers 
of the launch booster defined in Section III will serve as illustrations. 


JRIFT- MINIMUM PRINCIPLE IMPOSED 

The characteristic equation of the closed loop plant will be written as: 
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(28 


X 3 + A x X 2 + A 2 X + Ag = 0 
where, in the notation of Tables 1 and 2, 


A 1 ■ 

“ [| a 33 + b 3 K 3 ) V + b 2 ^2 J 


(29: 

A 2 

[( a 33 b 2 " a 23 b 3 ) “v K 2 

( a 21 + b 2 K l)] 

(3o; 

A 3 

"V [ ( a 33 b 2 a 2 3 b 3 ) K 1 + ( a 

2 l b 3 " a 31 b 2 ) K 3 

(31) 


+ ( a 21 a 33 " a 23 a 3l) 

m 


The drift minimum principle is defined by requiring Z = 0 when (f> is quasi- 
steady state. It can be shown that this is equivalent to = 0, and it is 
clear from (28) that one closed-loop pole is then at the origin (X = 0). Thus, 
setting (31) equal to zero gives a linear equation in and which must be 
satisfied to give a drift- minimum controller. Two gains remain unspecified, 
and iterations of minimax calculations (subject to A^ = 0) could be used to 
find a minimax drift- minimum controller. 


A further restriction on the class of controllers defined by (10) would be to 
impose the drift- minimum principle and require that the two unspecified 
pole locations be in the left half- plane. Then one would consider minimax 
controllers which satisfy A^ = 0 and the conditions specified in (32). 


A x > 0 
A 2 > 0 


(32) 


It is seen by referring to (29) and (30) that (32) gives two linear inequalities 
which must be satisfied by the controller gains. 
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ASYMPTOTIC STABILITY IMPOSED 

A still more restricted subclass of (10) would be controllers which are asymptotically 
stable. It can be shown that conditions (32) and ( 33 ) are necessary and that these, 
together with ( 34 ) are sufficient for asymptotic stability. 


A 3 > 0 

(33) 

^ 1^2 ^3 

(34) 


Note that such a controller can still be arbitrarily close to being drift- minimum 
by having Ag be sufficiently small. Minimax calculations would still be 
applicable in arriving at stable- minimax controllers. 
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SECTION X 
CONCLUSIONS 


Optimal control theory has been applied to a piecewise constant approximation 
of a large launch booster for the first 84 seconds of flight. This period was 
divided into seven intervals with a different constant approximation of the vehicle 
in each interval. The controllers considered are linear controllers with constant 
gains in each flight interval. The disturbances are the cross-winds of bounded 
amplitude which cause the maximum of any of several cost items to occur in 
each flight interval, and each cost item is proportional to some physical quantity 
of interest. The cost of a given controller is the maximum of its several cost 
items. 

The optimal control theory is presented in the appendix. In Section II, it is 
summarized and extended so that cost items whose corresponding physical 
quantity depends explicitly on the disturbances may be considered. This 
extension was necessary to consider a bending moment cost item. 

The theory provides a straightforward method of computing the cost of a 
finite set of controllers. The minimum-cost controller of the set is called 
the minimax controller of that set. It will usually be a sub-optimal controller 
since the cost computations (called minimax computations) are performed 
for only a finite set of controllers. 

Bending moment is weighted heavily in the cost items for the minimax com- 
putations. A comparison of control costs for specific drift-minimum controllers 
and minimax controllers is presented. It is found that, for the severe 
disturbances considered, drift-minimum controllers give excessive bending 
moments and gimbal deflections. Of course, they have low lateral velocities. 

The minimax controllers have acceptable gimbal angles, maximum bendings 
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moments which are nearly acceptable, and maximum lateral velocities which 
exceed those of the drift-minimum controller by a factor of only about 2. 5. 

It is shown that one can impose "classical" design criteria (e. g. , asymptotic 
stability) on the class of controllers to be considered and still use minimax 
computations to specify remaining control parameters. 
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APPENDIX 

MINIMAX CONTROL, OF LINEAR STATIONARY SYSTEMS 
WITH NONZERO INITIAL CONDITIONS AND 
AMPLITUDE BOUNDED DISTURBANCES 

by 

C. A. HARVEY 


ABSTRACT 

The design of an optimal controller with respect to a class of load dis- 
turbances is the problem which motivates this study. One result concern- 
ing this problem is presented here. It is assumed that the plant is represented 
by linear stationary equations of motion. A class of linear fixed-gain control- 
lers is assumed as the class of allowable controllers and the class of possible 
disturbances is assumed to be all disturbances which are uniformly bounded. 
For any given initial condition a method is presented for the computation of 
the performance index of any allowable controller. This result requires the 
integration of a system of piece-wise linear differential equations and the 
monitoring of the time history of the amplitude of certain piece- wise linear 
combinations of the components of the solutions to these differential equations. 


INTRODUCTION 

A technical statement of the problem considered is given, and the proposed 
method of solution is briefly described in the PROBLEM STATEMENT. The 
major result is then developed in the DERIVATION OF COMPUTATIONAL 
METHOD. 
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The special case when the initial condition was given to be zero and the class 
of admissible disturbances was all disturbances of uniformly bounded magni- 
tude had been solved previously. The more, general problem presented here 
has a somewhat more complicated but similar solution. The complication 
appears in two ways. First, there are additional linear homogeneous dif- 
ferential equations to be integrated. The other complication is the necessity 
of monitoring the time history of amplitudes of functions of the solution of 
the differential equations to ascertain the maximum amplitude attained on 
the time interval of interest. 


PROBLEM STATEMENT 


The following optimal control problem is considered. It is assumed that 
the plant is represented by the vector differential equation 

x - Ax + Bu + Cg, x(0) « x° (1) 


where x is an n- vector describing the state of the system, x° is the given 
initial condition, u is an m-vector representing the control inputs and g is 
a k- vector representing the disturbance inputs. A, B and C are constant 
matrices of appropriate sizes. Classes of allowable controllers and dis- 
turbances are assumed to be as follows: Qis a class of linear fixed-gain 
controllers, i. e. , u e Qif u = Qx + Rg with Q and R satisfying certain 
restrictions; G is defined by 


G = ^g(t) : a. ig. (t)£b., a. £b., i-1,2, ...,k; 


0^t^T,g(t) measurable 


.V 


J 


The requirements on Q and R may be specified by such considerations as; 
gain magnitude restrictions, sensor restrictions, stability requirements, etc. 
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To define the performance index it is assumed that constant n- vectors 
d(i), i = 1, 2,,, lt s are given. For u e 0, the cost functional C(u) is 
defined as 


C(u) = max C. (u) 

liiss 1 


where C. (u) = max max I d(i) , x(t;x° ,u,g)| , i=l,2,... J s J 

1 0<:t«£T geG 

with x(t;x° , u, g) representing the solution to (1). An optimal controller 
is a u e Q which minimizes C(u). 

It is desired to find an optimal controller. As a means toward this end a 
method will be developed by which (u) may be readily computed for any 
u e 0. This makes it feasible to compute C(u) for any u e Q. Then for a 
finite set of controllers A that spans Q , C(u) could be computed for each 
u 0 A. The optimal controller with respect to A then provides an approxi- 
mation to an optimal controller with respect to 0. 

The major step is the method of computation of Ch (u). This will now 
be developed. 


DERIVATION OF COMPUTATIONAL METHOD 

Assume u = Qx + Rg and let Aq and C R denote the matrices A + BQ and 
C + BR respectively. Also let h denote the k-vector with components 
hj = (a^ + bj )/ 2. Then for any vector d(i) the following equation may be 
obtained from the variation of parameters formula for the solution of (1). 

A n t t A n (t-T) 

d(i). x(t;x°, u, g) = d(i).e ^ x° + j d(i). e ^ C R h dT 

t A Q (t-T) 

+ T d(i). e ^ C R Jg(T)-hJdT (2) 

0 
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t 

A n t f A 0 (t- T ) 

Let X..(t) = d(i)* e .x° + J d(i)* e ^ C R h dTand set 
t A (t — t ) 

P^Ly) 25 J d(i)t e ^ C Ry(T)dT with y<T)= g(T)-h. Then | y ^.( t) | 

[ a 

tj y{% i)l where the j component of y(*r,i) is given by 


yj(T,i) = y(b.. - a.) sgn [d(i) 


V" T) 


R 


(j)] 


with 


th 


C r> (j) denoting the j column of CL and note that h + y<T, i) and h - y(T , i) 

li X\ 

belong to G. The maximizing and minimizing elements of G for the 
functional |ju(t,y) correspond to the functions plus and minus y(T,i) 
respectively. To verify this it is noted that 

k t ^ rp j 

=_ 2 _ ^ b j“ a j^ J l d ^’ e ^ C R (j)|dT 
0 


and hence 


^(tj-p^t, y)=y S (L-a^.) JV | d(i) - cp(j,t-T) | -d(i)« cp(j, t-T) 


y j <T) 

,b.-a. 
L 3 3- 


dT 


where 


A n (t-T) 

cp(j,t- T ) = e y C R (j> 
y i (T) 1 

and | J -.pfor each g e G. Each integrand is non negative 


and hence p^(t) i|j..(t, y) which together with the fact that [^(t, -y)= - p.(t, y) 
gives the desired result that 

-p.(t) ^p.(t, y) <:|x.(t) for any g e G. 
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From the expression for n-.(t) it is clear that (0)= 0 and p..(t) is monotone 
nondecreasing in t. 

Now it is clear that 


max | d(i)-x(t;x°,u, g) | = max | X.(t) + u.(t, g) | 
geG geG 1 


and it will be established that 


max | X.(t) + |x. (t, g) |= | X.(t) | + u- (t) 
geG 11 11 

Clearly,max | \.(t) + |x (t, g) | s max < |X..(t) |+ | [x.(t, g) |> = |Mt) | + p (t). 
geG 1 1 ' geG V 1 J 

If K.(t) ^0, | \ .(t) i+ |A.(t) |= |\^(t) | + |x.(t) and if \,.(t) < 0, 

| \.(t) - fx^(t) | = | -\.(t) + p^(t) | = | X^(t) j + pL^(t) and hence there 
is a g e G such that | X^(t) + |i.(t , g) | = | X..(t)‘ | + p.(t) which 
establishes the desired result. 

Thus C.(u) = max I\ \.(t) | + fx.(t) >. It will next be 
1 teO,T 1 1 1 J 

shown that \^(t) and (ju(t) may be obtained as solutions of differential equations. 
As solutions are generated by numerically integrating the differential 
equations it is easy to generate the time function, | X_(t) | + M-^(t) and monitor 
it on the interval 0 £ t £ T to determine the maximum value attained there. 

Let p(t) , q(t),r(t, j), j=l,2,...,kbe solutions of the 

differential equation y = A^y which satisfy p(0) = x°, q(0)= C-^h, 

r(0, j)= 4* (b -a.) C R (j) . Also let v. (t) = d(i)* q (t), v.(0)= 0 and 
. k 

w. (t)= E | d(i)» r(t, j) |, w. (0)= 0, i=l, 2, . . . , s. Then \ . (t)= d(i)* p(t) + v. (t) 
3=1 1 

and (t) = w.. (t). Thus everything necessary for the computation of C(u) 
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may be obtained by integrating n(k+2) + 2s first order differential equations, 
all but s of which are linear and the remaining s are piecewise linear. The 
required integration can readily be carried out on a high speed computer. 


CONCLUSIONS 

A computational procedure is presented which may be used to find an 
approximation to the optimal controller for linear constant coefficient systems 
having a nonzero initial condition when the system is subjected to a class of 
load disturbances that are bounded in amplitude. The procedure requires the 
integration of an autonomous piece-wise linear system of differential equations 
and monitoring the magnitude of piece-wise linear combinations of component 
of the solution to the differential equation system. 
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